GazeDrone: Mobile Eye-Based Interaction in Public Space Without Augmenting the User

Gaze interaction holds a lot of promise for seamless human-computer interaction. At the same time, current wearable mobile eye trackers require user augmentation that negatively impacts natural user behavior while remote trackers require users to position themselves within a confined tracking range. We present GazeDrone, the first system that combines a camera-equipped aerial drone with a computational method to detect sidelong glances for spontaneous (calibration-free) gaze-based interaction with surrounding pervasive systems (e.g., public displays). GazeDrone does not require augmenting each user with on-body sensors and allows interaction from arbitrary positions, even while moving. We demonstrate that drone-supported gaze interaction is feasible and accurate for certain movement types. It is well-perceived by users, in particular while interacting from a fixed position as well as while moving orthogonally or diagonally to a display. We present design implications and discuss opportunities and challenges for drone-supported gaze interaction in public

Social attention with real versus reel stimuli: toward an empirical approach to concerns about ecological validity

Cognitive neuroscientists often study social cognition by using simple but socially relevant stimuli, such as schematic faces or images of other people. Whilst this research is valuable, important aspects of genuine social encounters are absent from these studies, a fact that has recently drawn criticism. In the present review we argue for an empirical approach to the determination of the equivalence of different social stimuli. This approach involves the systematic comparison of different types of social stimuli ranging in their approximation to a real social interaction. In garnering support for this cognitive ethological approach, we focus on recent research in social attention that has involved stimuli ranging from simple schematic faces to real social interactions. We highlight both meaningful similarities and differences in various social attentional phenomena across these different types of social stimuli thus validating the utility of the research initiative. Furthermore, we argue that exploring these similarities and differences will provide new insights into social cognition and social neuroscience

Suppressing Bias Stress Degradation in High Performance Solution Processed Organic Transistors Operating in Air

Solution processed organic field effect transistors can become ubiquitous in flexible optoelectronics. While progress in material and device design has been astonishing, low environmental and operational stabilities remain longstanding problems obstructing their immediate deployment in real world applications. Here, we introduce a strategy to identify the most probable and severe degradation pathways in organic transistors and then implement a method to eliminate the main sources of instabilities. Real time monitoring of the energetic distribution and transformation of electronic trap states during device operation, in conjunction with simulations, revealed the nature of traps responsible for performance degradation. With this information, we designed the most efficient encapsulation strategy for each device type, which resulted in fabrication of high performance, environmentally and operationally stable small molecule and polymeric transistors with consistent mobility and unparalleled threshold voltage shifts as low as 0.1 V under the application of high bias stress in air

Instructor presence effect: Liking does not always lead to learning

The final publication is available at Elsevier via https://dx.doi.org/10.1016/j.compedu.2018.03.011 © 2018. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/Online education provides the opportunity to present lecture material to students in different formats or modalities, however there is debate about which lecture formats are best. Here, we conducted four experiments with 19–68 year old online participants to address the question of whether visuals of the instructor in online video lectures benefit learning. In Experiments 1 (N = 168) and 2 (N = 206) participants were presented with a lecture in one of three modalities (audio, audio with text, or audio with visuals of the instructor). Participants reported on their attentiveness – mind wandering (MW) – throughout the lecture and then completed a comprehension test. We found no evidence of an advantage for video lectures with visuals of the instructor in terms of a reduction in MW or increase in comprehension. In fact, we found evidence of a comprehension cost, suggesting that visuals of instructors in video lectures may act as a distractor. In Experiments 3 (N = 88) and 4 (N = 109) we explored learners' subjective evaluations of lecture formats across 4 different lecture formats (audio, text, audio + text, audio + instructor, audio + text + instructor). The results revealed learners not only find online lectures with visuals of the instructor more enjoyable and interesting, they believe this format most facilitates their learning. Taken together, these results suggest visuals of the instructor potentially impairs comprehension, but learners prefer and believe they learn most effectively with this format. We refer to as the Instructor Presence Effect and discuss implications for multimedia learning and instructional design.Social Sciences and Humanities Research Council of Canada SSHRC) Insight Discovery Grant (70104)Canada Research Chairs program (056562)Early Researcher Award from the Province of Ontario (058402)Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery Grant (RGPIN-2014-06459

Intelligent problem-solvers externalize cognitive operations

The use of forward models (mechanisms that predict the future state of a system) is well established in cognitive and computational neuroscience. We compare and contrast two recent, but interestingly divergent, accounts of the place of forward models in the human cognitive architecture. On the Auxiliary Forward Model (AFM) account, forward models are special-purpose prediction mechanisms implemented by additional circuitry distinct from core mechanisms of perception and action. On the Integral Forward Model (IFM) account, forward models lie at the heart of all forms of perception and action. We compare these neighbouring but importantly different visions and consider their implications for the cognitive sciences. We end by asking what kinds of empirical research might offer evidence favouring one or the other of these approaches

Cue-target contingencies modulate voluntary orienting of spatial attention: dissociable effects for speed and accuracy

Voluntary orienting of spatial attention is typically investigated by visually presented directional cues, which are called predictive when they indicate where the target is more likely to appear. In this study, we investigated the nature of the potential link between cue predictivity (the proportion of valid trials) and the strength of the resulting covert orienting of attention. Participants judged the orientation of a unilateral Gabor grating preceded by a centrally presented, non-directional, color cue, arbitrarily prompting a leftwards or rightwards shift of attention. Unknown to them, cue predictivity was manipulated across blocks, whereby the cue was only predictive for either the first or the second half of the experiment. Our results show that the cueing effects were strongly influenced by the change in predictivity. This influence differently emerged in response speed and accuracy. The speed difference between valid and invalid trials was significantly larger when cues were predictive, and the amplitude of this effect was modulated at the single trial level by the recent trial history. Complementary to these findings, accuracy revealed a robust effect of block history and also a different time-course compared with speed, as if it mainly mirrored voluntary processes. These findings, obtained with a new manipulation and using arbitrary non-directional cueing, demonstrate that cue-target contingencies strongly modulate the way attention is deployed in space

Computationally Aided Design of a High-Performance Organic Semiconductor: The Development of a Universal Crystal Engineering Core

Herein, we describe the design and synthesis of a suite of molecules based on a benzodithiophene “universal crystal engineering core”. After computationally screening derivatives, a trialkylsilylethyne-based crystal engineering strategy was employed to tailor the crystal packing for use as the active material in an organic field-effect transistor. Electronic structure calculations were undertaken to reveal derivatives that exhibit exceptional potential for high-efficiency hole transport. The promising theoretical properties are reflected in the preliminary device results, with the computationally optimized material showing simple solution processing, enhanced stability, and a maximum hole mobility of 1.6 cm2 V−1 s−1

Observing response processes with eye tracking in international large-scale assessments: evidence from the OECD PIAAC assessment

This paper reports on a pilot study that used eye tracking techniques to make detailed observations of item response processes in the OECD Programme for the International Assessment of Adult Competencies (PIAAC). The lab-based study also recorded physiological responses using measures of pupil diameter and electrodermal activity. The study tested 14 adult respondents as they individually completed the PIAAC computer-based assessment. The eye tracking observations help to fill an ‘explanatory gap’ by providing data on variation in item response processes that are not captured by other sources of process data such as think aloud protocols or computer-generated log files. The data on fixations and saccades provided detailed information on test item response strategies, enabling profiling of respondent engagement and response processes associated with successful performance. Much of that activity does not include the use of the keyboard and mouse, and involves ‘off-screen’ use of pen and paper (and calculator) that are not captured by assessment log-files. In conclusion, this paper points toward an important application of eye tracking in large-scale assessments. This includes insights into response processes in new domains such as adaptive problem-solving that aim to identify individuals’ ability to select and combine resources from the digital and physical environment

What Affects Social Attention? Social Presence, Eye Contact and Autistic Traits

Social understanding is facilitated by effectively attending to other people and the subtle social cues they generate. In order to more fully appreciate the nature of social attention and what drives people to attend to social aspects of the world, one must investigate the factors that influence social attention. This is especially important when attempting to create models of disordered social attention, e.g. a model of social attention in autism. Here we analysed participants' viewing behaviour during one-to-one social interactions with an experimenter. Interactions were conducted either live or via video (social presence manipulation). The participant was asked and then required to answer questions. Experimenter eye-contact was either direct or averted. Additionally, the influence of participant self-reported autistic traits was also investigated. We found that regardless of whether the interaction was conducted live or via a video, participants frequently looked at the experimenter's face, and they did this more often when being asked a question than when answering. Critical differences in social attention between the live and video interactions were also observed. Modifications of experimenter eye contact influenced participants' eye movements in the live interaction only; and increased autistic traits were associated with less looking at the experimenter for video interactions only. We conclude that analysing patterns of eye-movements in response to strictly controlled video stimuli and natural real-world stimuli furthers the field's understanding of the factors that influence social attention

Examining ecological validity in social interaction: problems of visual fidelity, gaze, and social potential

Social interaction is an essential part of the human experience, and much work has been done to study it. However, several common approaches to examining social interactions in psychological research may inadvertently either unnaturally constrain the observed behaviour by causing it to deviate from naturalistic performance, or introduce unwanted sources of variance. In particular, these sources are the differences between naturalistic and experimental behaviour that occur from changes in visual fidelity (quality of the observed stimuli), gaze (whether it is controlled for in the stimuli), and social potential (potential for the stimuli to provide actual interaction). We expand on these possible sources of extraneous variance and why they may be important. We review the ways in which experimenters have developed novel designs to remove these sources of extraneous variance. New experimental designs using a ‘two-person’ approach are argued to be one of the most effective ways to develop more ecologically valid measures of social interaction, and we suggest that future work on social interaction should use these designs wherever possible